Method and device for creating and editing object-inserted images

ABSTRACT

The present disclosure in some embodiments provides a method of generating an object-inserted image. A method in some embodiments is performed by an electronic device for inserting one or more objects into a main image to generate an object-inserted image, including determining a first position for inserting a second object into the main image in response to a user input, and identifying whether a first object is absent or present as a preinserted object at the first position in the main image, and inserting the second object at the first position in the main image when the first object is absent, and inserting the second object at a second position in the first object based on a user selection when the first object is present.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 14/781,911 filed on Dec. 10, 2015, which is a national stageentry of PCT/KR2014/002913 filed on Apr. 4, 2014, which claims thebenefit of Korean patent application No. 10-2013-0036683 filed Apr. 4,2013, the entire disclosures each of which are incorporated herein byreference.

TECHNICAL FIELD

This invention is associated with creating and editing images in mobiledevices such as smartphones. Particularly, this specification describesthe effective mechanism, installation and method to generate and editthe image created by inserting other image and video contents into acertain image.

BACKGROUND

When opening an image file using a personal computer or mobile device, amore detailed information or a more magnified image of a particular partof the image file may be required. For example, in the case of a figurephoto, information about the name of person in the image may berequired. In such case like this, the automatic or manual tagging of thename whose face in the image is recognized into the responding positionby device or system is utilized. As for any photo of automobile orsmartphone or other mechanical structure, a more detailed image may berequired in a profile showing thickness of automobile headlight,smartphone or connecting jack components, in which case the method ofmagnification is used or separate identification of the additionalmaterials that contain a detailed information on such part is required(e.g. search over hard disk and initialization of the respondingadditional material).

However, these like methods, namely the tagging of associated contentsto a particular part of image or the magnification of a certain part ofimage, have limited information to be entered or resolution to beprovided. And it is very cumbersome to separately look up for anadditional material.

DETAILED DESCRIPTION OF INVENTION Technological Task

This invention places its purpose in providing the method of generatingan object-inserted image which provides detailed information about animage by inserting into an image or video contents.

Also, another purpose of this invention is to provide a method ofstacking the object to be inserted at certain area, where there aremultiple objects to be inserted by which generate an object-insertedimages with multiple objects or contents inserted.

Moreover, this invention has the purpose of providing a gesture thatminimizes the touch input used when generating and/or editing the objectinserted image.

Technological Solution

In accordance with some embodiments of the present disclosure, a methodperformed by an electronic device for inserting one or more objects intoa main image to generate an object-inserted image, includes determininga first position for inserting a second object into the main image inresponse to a user input, and identifying whether a first object isabsent or present as a preinserted object at the first position in themain image, and inserting the second object at the first position in themain image when the first object is absent, and inserting the secondobject at a second position in the first object based on a userselection when the first object is present.

In accordance with another embodiment of the present disclosure, amethod performed by an electronic device for inserting one or moreobjects into a main image at multiple depths to generate anobject-inserted image, includes displaying the main image, receiving auser input for selecting a first position in the main image with a firstobject being present at the first position as a preinserted object,displaying the first object present at the first position in the mainimage, receiving a user input for selecting a second position forinserting a second object in the main image on the first object, andgenerating a multi-depth image with the first object and the secondobject hierarchically inserted in the main image at multiple depths byinserting the second object into the main image at a second position onthe first object.

Moreover, a mobile computing device can be used to solve theaforementioned technological tasks. The mobile computing device mayinclude control module, communication module, display module, filmingmodule, storage, and screen. Additionally, it may include input/outputpart and these components in the device can be deleted/added for theeffective use of technique. As for one example of practice execution ofmobile device for generating or editing object-inserted image: controlmodule that decides main image and generates or edits the objectinserted image; display module that displays main image and object; andthe storage for saving the above main image, object or object-insertedimage. The above control module enables the display module to displaymenu about the above object based on the first user input that isreceived from the above user, to display the icon about the above objecton the main image's certain location in overplay based on the user 2'sinput about the above menu, and to generate object-inserted image withthe above object inserted in the chosen place of main image based on theuser 3's input that moves the above icon to the main image's chosenplace.

This invention can be consisted of program codes composed of theprograms which perform the above sequential method. These program codescan be used in mobile computing device in the form of application orutilized for personal computer, laptop, desktop or digital cameras whichinclude computing device.

Moreover, this invention can be realized through a recording media thatcan be read by computer which includes such program codes of performingthe above-mentioned sequential method. The forms of recording media mayexist in many forms such as optical disk, flash memory, SSD, HDD, RAM,ROM. Recording media like these can perform the methods for solving thetask when used alongside with computing device that is applicable forthe recording media.

This invention can also be performed in a cloud computing system tosolve the aforementioned task. In a server it can perform the arithmeticnecessary for data saving and object-inserted image generating/editingprocess; in client's device it receives the user input (for exampletouch-base input) from the user and sends them to server and can alsodisplay in the device's screen the received processing result of thearithmetic from the server.

A detailed method and means to solve the aforementioned task isdescribed in the specification below and the request clause, whichshould be considered in an explanative perspective not in a limitedperspective.

Favorable Effect

According to the invention, it would be possible to receive diverse anddetailed information from single image by generating the image of one ormore images inserted.

Moreover, by using optimized gesture, it has the effect of generatingand editing object-inserted image through a simple and minimized input.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 roughly shows a method of generating object-inserted image.

FIG. 2 represents a method of inserting an object into main imageaccording to one practice execution.

FIG. 3 represents a method of entering object's content after decidingthe place the object is to the inserted.

FIG. 4 represents method of generating object-inserted image accordingto the different examples of practice execution of this invention.

FIG. 5 represents examples of device screen area division and itsrespective usage sample.

FIG. 6 represents a method of stacking objects at one side of screen.

FIG. 7 represents the flowchart of generating object-inserted image byinserting object image into the main image.

FIG. 8 represents the flowchart about generating object-inserted imageafter deciding the object and main image.

FIG. 9 represents an example of the way of determining the main image.

FIG. 10 represents a method of separating or deleting the object fromthe object-inserted image.

FIG. 11 represents the mobile device for realizing one practiceexecution of the invention.

FIG. 12 represents dimensionizing function according to the otherpractice execution of this invention.

FORMS FOR EXECUTING THE INVENTION

The following describes in more detail about this invention referring tothe figures.

FIG. 1 roughly shows the method of generating object-inserted image. Inthis specification, main picture or main image means the photograph intowhich objects are inserted. Also the contents inserted to the main imageare referred to as detail or object. Object can be an image, video,text, voice record, links to other files, or URL (Uniform ResourceLocator). Also object-inserted image means detailed picture into whichthe objects are inserted. That is, object-inserted image is consisted ofmain image and at least one object.

In reference to FIG. 1, a method of inserting detail 1 and detail 2 intothe main picture is shown. All the inserted details are supposed to, forconvenience be images all of which are taken by cameras of mobiledevices.

First, the main image (several flowers and trees) is taken. The mainimage taken is saved in mobile device's storage and the user maysuccessively take next pictures. After the main image is taken, camera'sfocus can be zoomed-in automatically or manually. Detail 1 (certainflower) is taken and will be displayed on the mobile device screen. Now,when the user touches a region of the displayed detail 1, main imagewill be displayed on the mobile device screen and a circle point, aminimized image of detail 1 or an icon that represents detail 1, etc.(hereinafter ‘icon’) is indicated at the location where the usertouched. The user now drags this icon from the main image of severalflowers and frees to the position of certain flower that correspondswith detail 1 and completes the touch input by taking off hands from themobile device touch screen. In this step, user can select shootingbutton or enter pre-arranged gesture movement that switches to shootingmode to switch the mobile device to shooting mode. After taking detail 2(Surface of tree), by the same method used for inserting detail 1, userdrags detail 2 icon to the position of trees in the main image andcompletes the touch input. Finally, user can generate object insertedimage with two details (detail 1, detail 2) inserted by clicking thesave button. Object-inserted images generated in this way can be viewedin mobile device's image viewer applications and etc. and when selectingthe inserted object region in object-inserted image it may be played (incase of the object being videos or audio files) or displayed on thedevice screen.

FIG. 2 represents the method of inserting objects to the main imageaccording to one practice execution of this invention. In reference toFIG. 2, user initializes shooting mode by using shooting module ofmobile device. If the object taken is an automobile, user initiallytakes picture of an overall appearance. The taken image is saved as amain image. This saving process is done by user's input or can be doneautomatically on the application that realizes shooting mode (step 201).

After main image is decided, user can take detail shots of eachautomobile structure separately. The taken image can be used as objectinserted to the main image. When taking detail shots, shooting mode canbe automatically switched into zoom-in mode. For example, once the mainimage is taken and stored, mobile device's control section can makeshooting module to automatically zoom-in in a pre-arranged rate.Alternatively, user can manually zoom in camera to take detail shots. Itis also possible to combine the aforementioned methods, which means thatshooting module automatically zoom in camera with the user manuallyadjusting the zoom-in rate. Now, user can take pictures of object's eachstructure magnified, or the detail image (such as headlight parts) (step202).

The object image taken can be displayed on mobile device screen. Whenuser keeps touching the image of displayed object for a while, an editmenu for the object image is displayed (step 203). This menu may includethe operation of attaching object to main image (In this specificationcalled as detailing), sending outside of mobile device through networks,and recording notes about the object, etc. Keeping the touch state anddragging the touch point to, for example, the location on the detailmenu the minimized or modified as an icon form will be displayed on thechanged touch point and the image displayed on the mobile device screenwill be changed from an object image to the main image (step 204).

In case where the filmed object is a video, after shooting is done, arandom image related with video such as preview image of video or firstframe of video will be displayed on the mobile device screen. Theprocess starting from the time when the user began touch input on anyimage is as same as the aforementioned normal image process, thus isexempt from explanation here. In the case of already taken and storedimage or video, it may be possible to perform detailing in the abovemethod after loading the image or thumbnail into screen from gallery.

After this, user drags the icon to a desired position (step 205). Inthis example where the detail image being the picture of magnifiedautomobile's headlight, user can move the detail icon to the mainimage's headlight area. After the completion of moving and when touchinput is completed (by taking hands off from touch based display),detail is inserted into the main image with an indication that detail isinserted at such point (step 206). User can finally generateobject-inserted image by saving this object-inserted image.

The main feature of this method is to minimize the interruption betweentaking shots (the method of inserting multiple objects to main image isdescribed later), when attaching details while taking a successive shotsof the object since position determination process is done by one touch(the action of touching screen once in case of mobile devices). If theobject is a picture or video, the process of choosing main image andloading the chosen image can be performed automatically, enabling thiskind of one-touch operation.

Also, these kinds of object-inserted image can be sent to SNS (SocialNetwork Services), blog, or web page through device's communicationmodule and also can be used in applications such as presentationsoftware, text writing software, or e-book writing software such asiBook Author of computing device. Thus, in applications like this whichsupports object-inserted images, when the object-inserted image isloaded and the part that indicates object is inserted (for example,semi-transparent circle point, marking such as number or thumbnail) isselected by touch Input, the original contents of the object can bedisplayed/played. Also, while playing/displaying the original contents,it is possible to return to the object-inserted image display through apre-arranged input and when editing is approved by the original author,a third person can insert the object into an image uploaded on web orreceived from another user.

The aforementioned method demonstrates the way of determining positioninto which the object is to be inserted after deciding (or generating)the object to be inserted into the main image. But in case of the objectbeing a text or audio file such as a voice record, it might not beappropriate to generate object-inserted image in this procedure. Inreference to FIG. 3, below is the method of determining a position wherethe object is to be inserted and of deciding the content of the objectto be inserted.

FIG. 3 represents a method of determining a position where the object isto be inserted first and then deciding the content of the object to beinserted. First user decides the main image (step 301). Main image canbe selected from saved images in mobile device's storage. Also picturestaken by filming module can also be chosen as main image. Main image canbe automatically determined by mobile device's control module inaccordance with a pre-arranged condition, which will be explained inmore detail hereafter.

The user touches a part of main image (step 302). In this specification,whether the image displayed in mobile device's screen is main image ordetail image, selecting a part of displayed image can call up a menu ofmain or detail image. Menu can also be loaded in another way; forexample, it can be loaded by selecting the already defined button on thedevice or through input of gesture defined before.

After touch input is received, related main image menu will be displayed(step 303). For example, when “input, detail, link, send” is displayed,while holding down the touch input, user can move the touch point to aposition where “input” is displayed. When user keeps touching the“input” menu for a certain time (step 304), detail generating menus suchas “text, record” can be displayed. Now user can drag the touch point toa position where he/she wants to insert detail into the main image sothat the desired menu (such as “text” menu) is approved and thencomplete the touch input (step 305). When touch input is competed,interface (such as virtual keyboard) is automatically provided (if inthe aforementioned process, the menu user wanted was “record”, interfacefor recording voice is provided), and when object generation iscompleted through detail contents input (step 306), text insertedobject-inserted image is generated at the associated position (step307).

FIG. 4 represents a method of generating object-inserted image accordingto another practice execution of this invention. Through the methoddescribed in FIG. 4, user can generate object-inserted image bypassingmenu displaying process.

Under the state where the object to be inserted in main image isdetermined (for example, the state up until FIG. 2 step 202), user candirectly proceed to the step where the user places the object icon tothe desired place in main image by continuously entering (dragging) apre-defined gesture while touching object image instead of performingthe operation of moving touch point to the associated menu after menu isdisplayed by touching the displayed object image (the operation of step203). For example, at the point where object image shooting is completed(step 202) in the FIG. 4, user moves up and down the touch input bydirectly touching object image (step 403). Then main image is displayedin mobile device's screen while at the same time object image istransformed into icon and located at the final touch point (step 404).Now user can generate object-inserted image by moving the icon to adesired position and finishing touch input (step 205). Of course, formsof gesture can be defined in various ways. For example, bypass techniquecan be realized by inputs such as down and up or tripe touch. It ispossible to assign each bypass definition to perform separate order suchas text input, voice record, or sending etc.

Operations like this can be performed repeatedly. Thus, user can entersame gesture (up and down) after detail 1 is inserted to main image,taking picture of detail 2 and the picture of detail 2 is displayedaccording to the aforementioned procedures. After entering gestures,user places the generated icon at the desired position and finishestouch input. By performing procedures like this repeatedly, image withmultiple objects inserted can be generated.

Before explaining about the alternative method of generating image withmultiple objects inserted, screen composition of mobile device will beexplained. FIG. 5 represents the example of division of device screenarea and its respective usage. In reference to FIG. 5, mobile devicescreen in this specification can roughly be divided into four areas. Thefirst area to display image (501, display area), the second area toindicate the object icon temporarily (502, stacking area), the thirdarea to direct the full area of mobile device screen (503, full screenarea), and the fourth area that is used for importing gallery (510) ordeleting (520) objects (details) (504, Gallery and trash area). A partor all of these areas can be overlapped with other areas. For example,in the represented example although the second area (502) is illustratedas comprising a certain left top area inside the first area (501), itcan be located in right or upper/lower area and further can be locatedthird area (503)'s certain region which is located outside of the firstregion (501). Also while main/objects that are being edited aredisplayed in the first area (501), when object is selected and contentsare being displayed/played in the object-inserted image, it can beperformed using a whole region of third area (503). Although the fourtharea (504) is illustrated as if including the outside area of the devicescreen, this is to help understanding since gestures or touch inputsthat use the fourth area (504) usually move objects from outside toinside of the screen or vice versa.

Now in reference to FIG. 6, it is explained how to insert multipleobjects in the main image. FIG. 6 represents the method of stackingobjects at one side of screen. This stacking technique means to place aminimized form of object such as icons at one side (right or left) ofthe screen instead of inserting into the main image. Stacked object isalways displayed on the top of screen (the top layer), separately fromfirst area (501). Thus, while the screen displayed on the first area(501) is switched to camera, image gallery or other screens, the objectstacked on the second area (502) will be displayed on the top of screenas long as the process of generating or editing object inserted image isnot finished.

This function enables one to perform repeatedly the operation ofstacking objects in the second area (502), further allowing the user toperform separately the operation of inserting object into the main imageand the operation of shooting object image. Also, one can load a savedimage (for example, image gallery) by entering a pre-defined gesture(for example, dragging from first area or fourth area's outside acrossthe third area to the second area). Through this, it is possible toinsert the saved images into main image while shooting object imagesseparately. Moreover, it is also possible to operate in the way firststacking the filmed detail 1,2,3 in the second area (502), theninserting and saving the detail 1,2 by opening up image gallery andloading first main image, and again loading second main image, insertingdetail 3 and then saving it. Detail stacking feature allows users tomodify the procedure and methods of generating object-inserted image,and also the main image.

In regard of modifying main image, it is explained later in reference toFIG. 9. In step 204 explained in reference to FIG. 2, user moves icon tothe second area (502) (step 605). Now once user takes off her/his handfrom mobile device's screen (finishing touch input), icon is stacked inthe second area (502). User can additionally take pictures of tirewheels and move them to the second area (502) (step 606). Repeatingprocedures like this, user can stack multiple icons in the second area(502). Now selecting one of the stacked icons (starting touch input)(step 607) then dragging it to a desired position and taking hands off(finishing touch input), object that corresponds with the selected iconis inserted into the main image. After that user can insert multipleobjects into main image by selecting other stacked icons and draggingthem to the desired position (step 608).

FIG. 7 represents a flowchart of generating object-inserted image byinserting object image into main image. In reference to FIG. 7, at step701, mobile devices' control area photographs the object according toshooting signal from user's input and saves this as a first image in thestorage. User's input signal can be touch-base or physical key/buttoninput. The saved first image above does not have any objects insertedinto it and thus can be decided to be main image. At step 702, secondimage is photographed according to the user input signal. At step 703,when the mobile device receives touch input signal of a part of secondimage, it can display menus that are applicable to the second image atstep 704. This menu may be displayed immediately after the input orafter the touch input has been continued for a certain amount of time.

Second image's icon is overlaid on the first image when the menu isselected at step 705. The following describes step 705 in more detail.User keeps continuing the touch input that he/she entered at step 703.When menu is displayed user moves the touch point to the position ofmenu (for example, “Detail”) while still keep continuing the touchinput. When the touch point is moved to the position of menu (or if thetouch input is kept for a certain amount of time after moving), thesecond image that was being displayed in first area is switched to thefirst image with the second image being transformed into icons and suchand placed in the position of touch point.

At step 706 when the touch input is finished after second image's iconis dragged (that is, after touch point is modified), mobile device'scontrol module inserts the second image in the place where touch inputis finished on the first image. The inserted second image can beattached to the first image as an icon or as a minimized image form, orthere can only be some numbers or texts that indicate an inserted imageexists. Furthermore, depending on mobile devices, there may not be anyindications until a particular input is received at which point anindication that object is inserted shows up.

At step 707, control module generates and stores the first image withthe second image inserted into it. Control module can generateobject-inserted image at the point where touch input is finished, canalso generate object-inserted image after a while the touch input isfinished, and can generate object-inserted image after receiving fromuser a separate input that indicates object-inserted image generatingprocess completion after touch input is finished.

In FIG. 7, similar to what is explained in FIG. 1, the methods ofgenerating object-inserted image while photographing images. But moregenerally, the contents that comprises object inserted images do notnecessarily have to be images neither does it have to be photographedimages. In FIG. 8 ways to generate object-inserted images by decidingthe main image and details.

FIG. 8 illustrates a flowchart of generating object-inserted imagesafter deciding image or details. In reference to FIG. 8, main image isdetermined at step 801. Control module usually decides the most recentlytaken or saved normal pictures, that is pictures without any detailsinserted, as a main image. The chosen main image will not be changeduntil object inserting operation is completed unless the user changes itwith another image.

FIG. 9 illustrates one example of how main image is determined. FIG. 9may represent image gallery (900) saved in the storage. Let's say thatas you go to the left side, the older the images are. Images that aremarked which is image 1 (901), image 4 (904), and image 8 (908) arenormal images while images without the mark are the ones that are usedas details which is image 2 (902), image 3 (903), image 5 (905), image 6(906) and image 7 (907). Thus image 2 (902) and image 3 (903) recognizesimage 1 (903) as main image and image 5 to 7 (905,906,907) recognizesimage 4 (904) as main image. Alternatively, when images without objectsinserted and images with objects inserted are mixed within imagegallery, control module can pre-determine the most recently taken/savedimage among normal images without objects inserted as main image.

In reference to FIG. 8, object is determined at step 802. Same asmentioned above, objects are not limited to images. Normally objects canbe photographed images by filming module, a video, texts that is writtenin regards to main image, voice record and URL, etc. Images and videossaved in the storage can be selected as objects and according to userinput, objects such as texts and voice records can be made. At step 803when the displayed object on screen, that is image or video's preview,etc. is selected, menus about the object is displayed at step 804. Atstep 805, when menu is chosen, object's icon is overlaidsemi-transparently on main image and at step 806, when touch input isfinished after dragging object's icon to a desired position,object-inserted image is generated at step 807. Explanations thatoverlap with already mentioned descriptions are skipped in the above.

In reference to FIGS. 8 and 9 to examine how main image is determinedagain, when image 2 (902) is taken after image 1 (901) is photographedby the user, if one tries to insert image 2 (902) as an object thenimage 1 (901) is automatically determined as main image. When trying toinsert image 3 (903) as an object after inserting image 2 (902) intoimage 1 (901), control module displays image 1 (901) as main image onscreen (first area (501)) since image 2 (902) is an object image. Now,after image 4 (904) is taken, if nothing is done to image 4 (904) andtakes image 5 (905), even if user intended to insert image 5 (905) intoimage 1 (901), control module recognizes image 4 (904) as main image anddisplays it on the screen since it is a normal image that has not beenused as an object. In this case, a change of main image is required.

Also multiple main images can be displayed fixed on the bottom of secondarea as a form of thumbnail. When touch input is kept for a while on oneof the thumbnails of main image located in the bottom of second area,the main image is automatically displayed on the whole screen of thirdarea. The touch input of the object may have been kept at this point.For example, if touch input is moved onto main image's thumbnail on thebottom while keeping the fingers on the object, main image is displayedas a full screen and the user can insert object without taking thefingers off the screen and by moving to a desired position. Throughmethods like this it is possible to import a desired main image in orderto insert multiple objects into random multiple main images withouthaving to go to gallery.

In cases like this, one can change main image through stacking operationand pre-determined gestures. User can determine and search images formain image through pre-defined gestures (for example, dragging fromoutside the screen to inside, or pressing button that summons imagegallery). At this point, control module remembers that image 4 (904) isnot being used as main image and prevents image 4 (904) from beingdisplayed as main image if image 6 (906) is photographed already. If itdoes not remember information about image 4 (904), when image 6 (096) istaken, then image 4 (904) will be again displayed as main image and userhas to modify main image by repeating the stacking and gesture inputs.This is thus an ineffective procedure.

FIG. 10 illustrates methods of dividing or deleting objects fromobject-inserted images. In example 1010, detail 1 (1011) and detail 2(1012) are inserted into the object-inserted image. When trying toseparate or delete detail 2 (1012), user can separate or delete it byperforming a pre-defined gestures onto the inserted objects. Forexample, if one provides touch input so that inserted details are passedthrough for a certain number of times, (1) After being passed throughfor a certain number of times (for example, 3 times like the solid linearrows), objects are separated from main image (1022) and thus can movealong the touch point (1020). Separated objects like this can be stackedin second area (502) or can be deleted by an additional input (forexample, gestures like dragging object's icon from inside to outsidetoward fourth area that deletes the icon when it's placed on it). Foranother example, (2) when touch input passes through the inserted objectfor more than a certain number of times, the object inserted can bedeleted from main image immediately (1003). Inputs that delete objectsin this way can be performed in any processes mentioned until now (Notethat it is after the step that object icon is generated), and in casesof picture and videos, even if the object (icon) is deleted, theoriginal file of the object may not be deleted.

FIG. 11 illustrates mobile device for realizing this invention's firstpractice execution. Mobile device (1) may include control module (2).Filming module (3), communication module (4), storage (5), screen (6),display module (7). This is an example structure and the consistingstructural elements can be added or deleted depending on the businessperson's realization. For example, when generating/editing objectinserted image with only photographed image or filmed video,communication module (4) can be deleted.

Control module (2) may be a processor such as CPU, etc. Control module(2) controls mobile device (1)'s entire operation and operates as a formof editing module when generating/editing object-inserted images. Also,control module (2) may include its own memory separate from storage (5).

Filming module (3) is generally used for operating cameras installed inmobile computing device. Filming module (3) can operate more than onecamera (ex. Front and back camera). Filming module (3) can performoperations such as image tuning, adjusting brightness and saturation,panorama shooting, etc. in relation with the control module (3).

Communication module (4) takes care of data sending/receiving. Also itcan receive data necessary for generating and editing object insertedimages and can send the generated object inserted images to outsidedevice or outside network. Communication module (4) can construct andkeep not only line connections like LAN, Intranet but also wirelessconnections like Bluetooth, NFC. Moreover, it can construct and keepconnection of telephone communication networks such as PSTN (publicswitched telephone network), 3G, 4G, LTE, and WAN (Wide Area Network).

Storage (5) saves image and objects. Storage (5) can also processtemporary saving of the stacked objects in second area (502). Whenmobile device (1) is zero client terminal or thin client terminal basedon cloud computing foundation, storage (5) can be deleted from mobiledevice (1)'s consisting elements (in this case data are stored instorage of cloud server).

On screen (6), image, video, text, etc. are displayed. Screen (6) canreceive touch input. Touch inputs that screen (6) can receive includeselectronic touch that generates electronic signals by touching thescreen directly with fingers and such, resistive touch that generatespressure by directly pressing the screen with fingers, pen and such, orin case of special pens, without having to directly touch screen (6),anti-contact touch input which generates light or electronic signalsthat is related to the pen when it is within a certain distance to thescreen and gesture inputs where the camera or muscle generatesrecognizable electronic signals. In this specification, touch input canbe understood as all the touch inputs mentioned above.

Display module (7) receives and processes aforementioned touch inputsand performs necessary operations for contents' display. Display module(7) can be combined with control module (2) to perform theaforementioned operations.

Although not illustrated in the figures, speaker and microphone forvoice recording and printing, physical buttons for a particular input, aconnecting jack that enables receiving inputs through connection withkeyboard/keypad, etc. can be included in mobile device (1).

Mobile device (1) like this can generate object inserted images.Specifically, control module (2) can determine main image and generateand edit object-inserted images. Display module (7) displays objects onscreen (6). This object may be image or videos, etc. that are saved instorage (5) or photographed images by filming module (3) or a videopreview. Control module (2) makes display module (7) to display menuabout the object when user's input about displayed object is received(touch start). When user input about displayed menu is received (touchcontinuing), control module (2) makes display module (7) to display mainimage and display the iconized object on main image in overlay. When useinput about moving object icon to a desired position on main image isreceived or finished (touch completion), control module (2) can sendthrough communication module (4) to outside device or outside network orsave in storage (5) after generating object-inserted image in the chosenposition.

In regard of the aforementioned methods and devices, various deviationsor additional embodiments may be possible. For one example,object-inserted image may have some depth. If the image object insertedto main image also has another image object (second image) inserted intoit, main image can be defined as having the depth of 1. If theaforementioned another image object (second image) also has additionalimage (third image) inserted, main image is defined as having a depth of2. For example, when a car's headlight image (image 1) is inserted tothe main image showing an entire automobile, and if blueprint ofheadlight's lamp part (image 2) is inserted to the car's headlight image(image 1), this object-inserted image has a depth of 1. Additionally, iffilament image (image 3) is inserted to blueprint (image 2)'s filamentpart, this object-inserted image has depth of 2. For object a mainimages that contains depth, numbers can represent the depth throughicons or thumbnails.

Methods for inserting additional objects to object images can berealized in following ways. In the state where at least one object(image 1) is inserted to main image, user moves the object (image 2)that he/she wants to add onto the already inserted one object (image 1)and wait for a certain amount of time. Now, if the one object (image 1)inserted to main image is displayed on the screen (ex. area 1 (501)),keeping the touch input, user should move the object (image 2) thathe/she wanted to add onto the desired position on the already insertedobject (image 1) and finish touch input. Meanwhile, the image 2 may beinserted into the main image with an depth equal to or different fromimage 1. For example, when receiving a depth selection command from auser, the mobile device determines whether or not the command indicatesthe same depth. When the depth selection command indicates the samedepth, the mobile device generates an equi-depth image with image 1 andimage 2 equivalently inserted with an equal depth by inserting image 2at the same position as image 1 in the main image. When the depthselection command indicates a deeper depth, the mobile device generatesa multi-depth image with images 1 and 2 hierarchically inserted in themain image with multiple depths by inserting image 2 at a position onimage 1 which was already inserted in the main image.

During the process of deciding the object's position to be insertedinto, main image's enlarging or reducing can be done by gesture. Forexample, keeping the touch input on object (or object icon), when onedrags touch input in a formation of drawing a circle rightward, mainimage may be magnified. Inversely, when the circle is drawn leftward,main image may be reduced. This enlargement/reduction is required sinceobject is inserted to main image when touch input is finished on thescreen (taking the fingers off). But when object's icon is stacked insecond area (502) and etc., since touch input is temporarily stopped, itis possible to use normal zoom features such as pinch-to-zoom or multitouch.

According to this invention's other practice execution, it can be useddisplay as a combined form that reveals the relation between objectimages and main image of front, back, left, right, top, bottom of 3Dstructured object. FIG. 12 illustrates dimensionalizing functionaccording to this invention's another practice execution.Dimensionalizing function enables generating a solid cluster structureby connecting in desired angles the pictures taken in various directionsof a three-dimensional object.

In reference to FIG. 12, a particular object (1201-1) inserted to mainimage can have a structure that includes multiple surfaces. Also, mainimage (1202) can be a multiple surface structure if it is generated bydimensionalizing function. Depending on the structure of object,surfaces can be connected in various ways—for example, in case ofinterior structure, structure (1203) that have walls connected with theceiling(or floor) as a center; in case of 3D structures that containsmany layers, structure (1204) that have connected pictures photographedmultiple times in same (or similar angle) depending on the needs; incase of circular space or plaza, structure (1205) that looks as ifsurfaces are stacked in 3D structure with detailed angle shots. On eachsurfaces, one can attach object image through detailing feature.

Object-inserted image or detailed picture's viewing can be done bymanual mode or automatic mode. While both modes supports the form whereobject is inserted to main image as an icon, slide form, relationshipdiagram form, or display mode that surrounds main image like tiles canalso be supported. For notes, manual mode represents a mode where oneselects each objects on the object-inserted picture to view originalcopy of objects and automatic mode represents a mode where objects areautomatically viewed according to the inserted order. Automatic modeprovides slide show viewing while manual mode doesn't.

This invention can be utilized in mobile messengers such as Kakao Talk,line and SNS such as Facebook, twitter. Also it can be used in internetshopping mall for generating product info pictures and also can be usedas real time report solution of branch inspections or constructioncompanies that require photograph information. Furthermore, it can beused for creating a presentation's picture materials or for simplyarranging one's personal pictures. Also it can be used in various fieldssuch as science inspection's filed data collecting or as a productiontool for creating homepage/blogs.

Business person may understand the block diagrams in this invention as aform of theoretically illustrating the circuit for realizing theinvention's principles. Similarly, arbitrary flow chart, flow diagram,state transition diagram, pseudocode, etc. are demonstratedrealistically in computer readable medium so whether computer orprocessor is clearly illustrated or not, business person may recognizethe as illustrating various processes that can be performed by computeror processor. Thus, aforementioned practice executions of this inventioncan be created by programs that can be performed in computer, and can berealized in normal digital computer that operates aforementioned programthrough computer readable recording medium. Recording mediums that arereadable in computer includes mediums such as magnetic storing medium(ex. Rom, floppy disk, hard disk etc.) and optical reader (ex. CD rom,DVD, etc.)

Illustrated functions of various elements can be provided through theusage of not only hardware that can operate appropriate software butalso through the usage of private hardware. When it is provided by aprocessor, functions like this can be provided by single privateprocessor, single public processor, or multiple individual processorsthat a allows a part of it to be shared. Also, the terms “processor” or“control part”'s usage should not be understood as exclusivelyindicating hardware that can operate software, and may include DSPhardware, read only ROM for saving software, RAM, and non-volatilestorage.

In this specification's request clauses, elements illustrated as a meansof performing a particular function includes arbitrary method thatperforms a particular function and these elements may include anassociation of circuit elements that perform a particular function, orarbitrary form of software that includes firmware, micro code, etc. thatare combined with appropriate circuit in order to perform software forperforming the particular function.

In this specification, terms such as ‘one practice execution’ anddiverse variations of these names mean to be included in at least one ofthe practice executions of this invention's principles in regards ofthis practice execution, certain feature, structure, property, etc.Thus, terms such as ‘one practice execution’ and other such arbitraryvariations throughout this specification does not necessarily indicatethe same practice execution.

In this specification, the term ‘between^(˜), at least one’ in the caseof ‘between A and B, at least one’, is used to include the first optionwhich is (A), the second option which is (B), and third option which isboth (A) and (B). For additional example, in the case of ‘at least onein A, B, and C’, it includes first option which is only (A), secondoption which is only (B), third option which is only (C), fourth optionwhich is both (A and B), fifth option which is (B and C), sixth optionwhich is (A and C) and the last option which is all (A, B and C). Evenif more options are enumerated, it is clear to be possibly expanded inits interpretation.

Up until now, we have examined this invention, mainly focusing onappropriate practice executions. All practice executions and conditionalexamples illustrated in this specification are written by the personskilled in the relevant field of technology for the purpose of helpingreader's understanding about this invention's principles and theories,and thus business person may understand that this invention can berealized in modified forms within the boundary the invention's essentialcharacteristics. Therefore, illustrated practice executions should beconsidered in explanative perspective, not in a limiting perspective.This invention's range or boundary is indicated in patent request range,not in the aforementioned descriptions and all differences within thesame boundary should be understood as included in this invention.

What is claimed is:
 1. A method performed by an electronic device forinserting one or more images into a main image to generate anobject-inserted image, the method comprising: displaying the main imageon a screen of the electronic device; determining a first position forinserting a second image, which is separate from the main image, intothe main image in response to a user input; identifying whether a firstimage, which is separate from the main image and the second image, hasbeen already additionally inserted at the first position in the mainimage in a substantially visually hidden state; in response toidentifying that no image has been additionally inserted at the firstposition in the main image, inserting the second image at the firstposition in the main image with original contents in the main image bemaintained, wherein the insertion of the second image at the firstposition in the main image causes the second image to be substantiallyvisually hidden in the main image without a user intervention; and inresponse to identifying that the first image has been alreadyadditionally inserted at the first position in the main image,displaying the first image which has been substantially visually hiddenin the main image on the screen of the electronic device and insertingthe second image at a second position in the first image which a userselects, with original contents in the first image be maintained,wherein the insertion of the second image at the second position in thefirst image causes the second image to be substantially visually hiddenin the first image without the user intervention, wherein, in a statethat the first image and the second image are inserted, the first imageand the second image are substantially visually hidden in the main imagewhen the main image is displayed on the screen of the electronic device.2. The method of claim 1, wherein the inserting of the second image atthe second position in the first image comprises: determining the secondposition in the first image in response to a user's input; andgenerating the object-inserted image with a plurality of imageshierarchically inserted into the main image in a multi-depth structure,by inserting the second image at the second position in the first image.3. The method of claim 1, wherein the first image is displayed on thescreen of the electronic device in response to a user's touch inputmaintained for a certain period of time to the first position in themain image.
 4. The method of claim 1, further comprising: selecting thesecond image to be inserted at the first position or the secondposition, wherein the second image is an image that one or more otherimages have been already inserted thereinto with one or more depths. 5.The method of claim 1, further comprising: displaying a plurality ofcandidate images in a partial area of the screen of the electronicdevice; and selecting, from the plurality of candidate images displayedin the partial area, the second image to be inserted at the firstposition or the second position according to a user's selection.
 6. Themethod of claim 1, further comprising: in response to at least apredetermined number of drag inputs across an area of the main image, inwhich the first image is inserted, separating the first image insertedin the area from the main image.
 7. The method of claim 1, wherein theinserting of the second image in response to identifying that the firstimage has been already additionally inserted at the first position inthe main image, further comprising: receiving a depth selection commandfrom the user; when the depth selection command indicates a same depth,generating the object-inserted image with the first image and the secondimage equivalently inserted into the main image with an equal depth, byinserting the second image at the first position in the main image; andwhen the depth selection command indicates a deeper depth, generatingthe object-inserted image with the first image and the second imagehierarchically inserted in the main image with multiple depths, bydisplaying the first image and inserting the second image at the secondposition in the first image which is inserted at the first position inthe main image.
 8. A non-transitory computer readable medium storing acomputer program including computer-executable instructions for causing,when executed in a processor, the processor to perform the method ofclaim
 1. 9. The method of claim 1, wherein a hidden image is displayedon the screen, in response to an input for selecting a position wherethe hidden image has been inserted.